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ABSTRACT 



A method for remotely controlling a computer having an 
associated screen for displaying output from the computer 
and having an internal cursor generated by the computer 
includes detecting at least one property of an external cursor 
relative to the screen and generating a command for the 
computer based on the at least one detected property of the 
external cursor. In one embodiment, the invention includes 
a computer connected to a projector which projects an image 
of the computer output onto an external screen. A camera is 
used to capture an image of the projected computer output. 
An optical pointer, such as a laser pointer, is used to generate 
and transmit an external cursor having various properties, 
such as color, shape, or intensity. The image captured by the 
camera is used to detect and process at least one property of 
the external cursor to generate a corresponding command or 
commands to control the computer. Commands may be used 
to emulate control of the computer typically provided by a 
pointing device such as a mouse or track ball. 

26 Claims, 2 Drawing Sheets 
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COMPUTER PRESENTATION SYSTEM AND similar characteristics relative to a computer display to 

METHOD WITH OPTICAL TRACKING OF provide commands to a computer. 

WIRELESS POINTER Yet another object of the present invention is to provide a 

system and method for remotely controlling a computer 

TECHNICAL FIELD 5 using position-related commands corresponding to charac- 

. teristics of an optical cursor superimposed on a computer 

The present invention relates to a system and method for display 

remotely controlling a computer by optically tracking and A stm farther object of the present invention is to provide 

synchronizing a wireless optical pointer with a projected a system and method for connectionless optical tracking of 

image of the computer screen. iq light in con j unction wilh a computer to emulate a conven- 

BACKGROUNDART tional computer pointing device 

In carrying out the above objects and other objects, 

A number of systems and methods for remotely control- features, and advantages of the present invention, a system 

ling a computer have been developed to adapt the conven- and method for remotely controlling a computer having an 

tional keyboard/mouse interface to a wide variety of user 15 associaled screen for displaying output from the computer 

applications and preferences. A variety of technologies and havin S an internal cursor generated by the computer 

including ultrasonic, infrared, and radio frequency (RF) include detecting at least one property of an external cursor 

have been used to afford users increased mobility relative to reiaUV * t0 K *% scre f. n ^ & e ( neral ' n S a command tor the 

the computer processor and/or display screen. TTiese tech- T P T 1°" °™ ?T P ? P * °! 

, external cursor. In one embodiment, the invention includes 

nologies typically employ custom transmitters/receivers to 20 a c uter connected t0 a projector which projects an image 

communicate control and status information between the of lhe mer ou| t onto a J Q extemal A camera B is 

user and the computer which may be used to control the used t0 capture an image of the pro j e cted computer output, 

computer. A number of systems use sensors positioned on a,, optical pomler> sucn aS a laser pointer, is used to generate 

the user, on the computer, and/or on a display screen to and transmit an external cursor having various properties, 

detect movement of the user and/or a wireless pointing 25 such as color, shape, or intensity. The image captured by the 

device relative to the sensors. While acceptable for certain camera is used to detect and process at least one property of 

applications, these techniques may be limited by line-of- the external cursor to generate a corresponding command or 

sight requirements or distance, for example. Likewise, these commands to control the computer. Commands may be used 

systems require complex and often expensive equipment to emulate control of the computer typically provided by a 

which may not be readily adaptable to different forums 30 pointing device such as a mouse, track ball, or the like, 

having audiences ranging from a few individuals to a filled The present invention provides a number of advantages 

auditorium. relative to prior art strategies. For example, the present 

As computers are increasingly being used for graphical invention allows the user to utilize a conventional optical 

presentations and/or demonstrations, larger display devices P ointI ^ device - su <* as a laser Pouter, t0 P">vide position 

_ „ . . • • u.. „. a- Z r • k; dependent commands to a remotely located computer. As 

are used to provide viewing by audiences of varying size. 35 r . fU * • i 1 *• 1 • 1 

* .. l i-j i_ j.uii- such, the present invention provides a relatively simple 

Many presentations, such as side shows and the like require rcmote U J imerface Mc P Qf mQrc histicate $ c J rol 

relatively simple control of the computer during the actual 0 f the computer, similar To a conventional computer pointing 

presentation. Commands which advance or reverse slides or devic ^ such ^ a mouse or track ball ^ m invemion 

initiate a display sequence require only a basic user interface permits a ^ t0 control a computer for a software demon- 

or remote control to communicate with the computer. 40 stratioQ from any location where the compuler XKtn or a 

However, more sophisticated presentations or projected image of the computer screen is accessible via an 

demonstrations, such as used for software user training or optical pointer. In one embodiment, the present invention 

promotion, require a more sophisticated interface or remote integrates a projector and video camera and/or frame capture 

control to effectively operate the computer. Conventional device within a single unit. 

strategies require the presenter to either remain within close 45 The above advantages and other advantages, objects, and 

proximity of the computer to operate the keyboard and/or features of the present invention, will be readily apparent 

pointing device (mouse, touchpad, track ball, etc.) or have from the following detailed description of the best mode for 

an assistant perform the required operations. carrying out the invention when taken in connection with the 

accompanying drawings. 

50 BRIEF DESCRIPTION OF DRAWINGS 

Thus, it is an object of the present invention to provide a FIG. 1 is a block diagram illustrating a representative 

system and method for remotely controlling a computer in a computer presentation system with optical tracking for 

similar manner as performed by a conventional pointing remotely controlling the computer according to the present 

device. ^ invention; 

Another object of the present invention is to provide a FIG. 2 is a diagram illustrating projection of calibration 

system and method for remotely controlling a computer reticles or fiducials and derivation of coordinates for an 

based on characteristics of an optical pointer used to super- external cursor of one embodiment according to the present 

impose a cursor or visual cue onto a projected image of a invention; and 

computer screen. An FIG. 3 is a flow chart illustrating operation of a system or 

A further object of the present invenlion is to provide a met 1 hod for f remo,el y «>nto>"ing a computer using optical 

. j , c , . . /, tracking of an external cursor according to the present 

system and method for synchronizing position and/or move- invention 
ment of a cursor on a computer screen with position and/or 

movement of an optical pointer. BEST MODE FOR CARRYING OUT THE 

An additional object of the present invention is to provide 65 INVENTION 

a system and method for detecting characteristics of an Referring now to FIG. 1, a block diagram illustrating a 

optical pointer, such as shape, color, intensity, motion, or representative computer presentation system wilh optical 



DISCLOSURE OF INVENTION 
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tracking for remotely controlling the computer according to 
the present invention is shown. As used herein, the remote 
control of the computer is intended to include control of 
various application programs and/or the operating system of 
the computer. In this embodiment, computer 10 is connected 5 
to a video projector 12 and a video camera 14. Video 
projector 12 projects an image 16 of the computer output 
onto a projection surface or screen, indicated generally by 
reference numeral 18. Preferably, screen 18 is a "passive" 
screen, i.e. a substantially planar surface remotely located 10 
from computer 10 and of a light color to provide sufficient 
contrast to the image of computer output generated by 
projector 12. Various objects may be used to provide such a 
surface, including projection screens, walls, or the like. 
Output from computer 10 may also be displayed on an 15 
"active" screen which would include a traditional computer 
screen 20 of laptop computer 10, or any other display device 
such as a monitor, television, or similar "active" device. 
Such "active" screens may be used alone, or in combination 
with one or more "passive" screens without departing from 2 q 
the spirit or scope of the present invention. 

As also illustrated in FIG. 1, an external cursor, indicated 
generally by reference numeral 22, is superimposed on 
image 16 which is output from computer 10. As used in this 
application, an external cursor is one which is generated 2 5 
externally relative to computer 10, i.e. generated by some 
other device which could include another computer, 
projector, or the like. In one embodiment, external cursor 22 
is generated by a hand-held optical pointer 24 which has the 
capability of varying at least one property of external cursor 30 
22. For example, optical pointer 24 may vary the color, 
shape, size, intensity, illumination pattern, motion, and/or 
position of external cursor 22 to generate one or more 
commands to remotely control computer 10 according to the 
present invention. In one preferred embodiment, optical 35 
pointer 24 is a laser pointer which generates an external 
cursor in one of two user-selectable colors. In this 
embodiment, the external cursor has a significantly higher 
intensity than the output of the computer and is therefore 
more easily detected. 40 

Preferably, camera 14 captures an image including at least 
a substantial portion of image 16 generated by projector 12. 
In an alternative embodiment where an active screen is 
utilized, camera 14 preferably captures at least a substantial 
portion of the active screen, i.e. computer monitor, display, 45 
or television. Computer 10 processes the captured image to 
determine at least one property of external cursor 22. In a 
preferred embodiment of the present invention, computer 10 
processes image 16 to determine at least the position of 
external cursor 22 and generates an appropriate command or 50 
commands to move an internal cursor 26 to approximately 
the same position as external cursor 24. Computer may also 
process image 16 to detect various other properties of 
external cursor 22 to generate position-dependent com- 
mands which are used to remotely control computer 10. 55 
Such position or context-dependent commands may emulate 
a "left-click" or "right-click" command generated by a 
traditional computer pointing device, such as a mouse, track 
ball, touch pad, or the like. Likewise, various other com- 
mands may be associated with one or more properties of 60 
external cursor 22 depending upon the particular applica- 
tion. 

In one embodiment of the present invention, computer 10 
may periodically generate reticles or fiducials, indicated 
generally by reference numeral 28, to calibrate or register 65 
the image captured by camera 14 relative to image 16 on 
screen 18. Preferably, each of the four corners of the image 



,214 Bl 
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of the computer output contains a reticle or fiducial and the 
fiducials are used to delineate the "active" tracking region 
where external cursor 22 is detected. The fiducials may be 
any appropriate shape such as a right-angle or cross as 
illustrated. For applications where screen 18 is not substan- 
tially planar, fiducials 28 should cover more of the screen. 
For example, fiducial lines may extend horizontally or 
vertically across screen 18. 

Preferably, projector 12 (when used), camera 14, and 
screen 18 are stationary and remain substantially fixed to 
facilitate the calibration (registration) and tracking process. 
However, the present invention could also be used in appli- 
cations where one or more of these devices changes position, 
although detection of the properties of external cursor 22 
becomes more complex and computationally intensive. The 
calibration or registration process may be repeated automati- 
cally at predetermined intervals, based on a user request, 
and/or when external cursor 22 is not detected. In one 
embodiment of the present invention, reticles or fiducials 28 
are progressively moved toward the position of external 
cursor 22 to simplify processing of the image to detect 
external cursor 22. In this embodiment, only the area delin- 
eated by fiducials 28 is searched or scanned to detect 
external cursor 22. If external cursor 22 is not located within 
the area defined by fiducials 28, their position is either reset 
to, or progressively expanded toward, the original corners of 
the processed image until external cursor 22 is detected. 

FIG. 2 represents a single image frame 40 captured by 
video camera 14. Pre fe rab lyjffra mes *a reinepe at edl y*ea pt u^ed 
and processed to detect at leasUonewproper^yfiofeexternal 
cursor 22. Typical frame capture rates are^thirjy^ojy^y 
frames per second. Preferably, the frame capture rate of the 
video camera and/or the output of an active screen or 
projector are selected to minimize aliasing and other inter- 
ference within the frequency bands of interest. Such inter- 
ference may be produced by the beat frequency or difference 
frequency between the refresh rate of the screen or projector 
and the video camera. Any such interference effects may 
also be reduced by appropriate filtering of the captured 
image. Filtering may be performed as part of the image 
processing by the computer, or may be performed by appro- 
priate hardware as part of the image capture process. 

Captured image frame 40 preferably includes a substantial 
portion of the computer output image, represented generally 
by reference numeral 42. As illustrated in FIG. 2, computer 
output image 42 may occupy a convex quadrilateral area 
within captured frame 40. Image 42 will not be rectangular 
if either or both of the projector and the camera are not 
located on the line which passes perpendicularly through the 
center of the screen. Preferably, the computer embeds or 
superimposes the reticles or fiducials 28 within image 42. 
Processing of captured image 40 may utilize line and 
intersection pattern recognition depending upon the particu- 
lar type of fiducials utilized to locate corners CI', C2', C3\ 
and C4\ Determination of the locations of CI', C2', C3', and 
C4' and the properties of the external cursor is simplified * 
because their identifying characteristics are known a priori. \J 
Identification of items within a static image and identifica- 
tion of dynamic motion of features may be accomplished 
using any number of known image processing techniques, 
such as those described in "MACHINE VISION" by Jain, 
Kasturi, and Schunk, published by McGraw-Hill, ISBN 
0-07-032018-7. The present invention is independent of the 
particular image processing techniques utilized to identify or 
detect the properties of the external cursor used to remotely 
control the computer. An exemplary method for determining 
position or location information of the external cursor is 
provided below. 
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The locations of comers CI', C2\ C3\ C4\ and external 
cursor 22 may be determined for a classic video quadrant 
system having horizontal coordinates represented by X and 
vertical coordinates represented by Y, with Y=0 representing 
the topmost scan-line. The number of scan-lines determines 5 
the maximum Y value. The positions corresponding to the 
coordinates for X=0 are the first (left-most) pixel in each 
scan-line, and the number of pixels per scan-line determines 
the maximum X value. The line segment C1-C2 corre- 
sponds to the X-axis, and segment C1-C4 corresponds with 10 
the Y-axis. Points interior to image 42 are represented with 
normalized (T, U) coordinates where CI' has coordinates 
(T=0.0, U=0.0), and C3' has coordinates (T=1.0, U=1.0). 
The normalized coordinates can then be scaled to an appro- 
priate resolution for image 40. Coordinates T and U can be is 
determined for any point in a given video frame using a pair 
of parametric equations. First, X-Y coordinate pairs for each 
of the corners CI' through C4' are represented as: 



dl: Cl'-CZ 
d2: C2'-C3' 
d3: C4'-C3' 
d4: CI , -C4* 

Where a difference value applies to the difference between 
values of only one coordinate, i.e. only the X or only the Y 
coordinate values, the difference is represented by either an 
X or Y, respectively, between the "d" and the number. For 
example, dX2 represents the quantity (X2-X3'), while dY4 
represents the quantity (Yl'-Y4'). The (X',Y l ) point pairs are 
then substituted for CI', C2\ C3\ and C4' in Equation 3, with 
the delta notation used to simplify the resulting equations. 
Depending upon how the four points multiplied by U are 
paired, one of the following equations results: 

piT,U)-[CV-U* d4]-7ldl-U(dl-d3)] 4: 



20 



30 



cr-cxr, Yi') 

C2'=(X2', Y2') 
C3'=(X3', Y3*) 
C4'»(X4\ Y4') 

The parametric equation for a line is P(Q)=P0-Q(P0-P1), 
where Q is replaced by T and then U in this example. The 
T-axis is defined using Cl'-C2* and C4-C3' while the U-axis 
is defined using Cr~C4' and C2'-C3'. Because the embed- 
ded quadrilateral defining image 42 is not guaranteed to 
have parallel boundaries, the mapping from (X,Y) to (T,U) 
is not a simple rectangular mapping in the general case. 
However, the mapping may be derived as described below. 

The parametric equations for the embedded quadrilateral 
boundaries defining image 42 are given by: 

Upper boundary (LT1): p(T)-CV-T\CV-Cl t ) 
Lower boundary (1X2): pifyCf-TXCA'-CS') 
Left boundary (LU1): p(U)-Ci , -t/(Cl'-C40 
Right boundary (LU2): /7(U>C2'-t/(C2'-C3') 

The mapping in (T,U) may then be defined by selecting 
either the LT pair or the LU pair and defining a parametric 45 
equation in the other variable (either U or T, respectively) as 
follows: 



p{T t U)-[CV- l/'d4]-7ldl- V(d4-d2)] 5 : 

Equations 4 and 5 are equally valid and each represents a 
pair of linearly independent equations, one in X and the 
other in Y because p(T,U) is represented by a generic 
coordinate pair (X, Y). Equation 5 is selected for this 
example and split into the X and Y equations: 

*-Xr-l/*dX4-r*dXL+t/7TdX4-dX2) 6: 

y-Yl'-U-dY4-7* dYl+t^(dY4-dY2) 7: 

Equations 6 and 7 are then solved for T and U, respectively, 
to produce equations 8 and 9 as follows: 

xr - x - u *<u 8 



35 



dXI -U(dX4-dX2) 

YI' - Y - T*dYJ 
~~ dY4 - T{dY4 - dY2) 



40 Because Equations 8 and 9 are linearly independent, either 
equation can be substituted into the other. In this example, 
Equation 9 is substituted into Equation 8 to obtain: 



xi' -x - dX4 



Yl'-Y-T*dYl 
dY4 - T(dY4 - dY2) 



dXi-(dX4-dX2) 



yy - Y - T*dYf 
dY4 - T[dY4 - dY2) 



/>(7>LU1-7T(UJ1-LU2) 

or, equivalently: 

/?(t/)=LTl-t/(LTl-LT2) 



50 Which is now only an equation in T for an arbitrary point 
having coordinates (X/Y) in the original space. Solving 
2: Equation 10 for T yields a simple quadratic in T: 



Equation 1 represents how the U-axis scales and/or rotates 
as it traverses the (T,U) space from its location at T=0, to its 
location at T=l. Equation 2 represents how the T axis scales 
and/or rotates as it traverses the (T,U) space from U=0, to 
U=l. As indicated above, either equation may be used to 
determine a parameteric equation in the other variable. In 
this example, Equation 1 is selected and the equations for 
LU1 and LU2 are substituted into Equation 1 to generate 
Equation 3 as follows: 

p(j;U)-[Cl'-t/(Cl , -C4')]-7-{[Cl-rj(Cl'-C4')]-[C2'-^C2'-C3 , )B: 



0=AT 2 +BT+C 11: 
A*dYl(dX4-dX2)-dXl(dY4-dY2) 

B«dXl -d Y4- (Y 1 - y)(dX4-dX2j-dYl*dX4+(X 1 -X)(d Y4-d Y2) 
C=dX4-(Yl-Y)-dY4(Xl-A-) 

Equation 11 may then be solved using the quadratic formula. 
In Equation 11, A is constant, while B and C vary depending 
upon the values of X and Y. As such, if the lines formed by 



55 where 



60 



To simplify the notation, it is useful to define a shorthand 65 extending the segments Cl'-CT and C4'-C3' intersect, there 
notation representing the differences or deltas between coor- will be two solutions to Equation 11, one of which is the T 
dinates of the corner points as follows: coordinate of the point of intersection, the other of which is 
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the correct value for T. If the lines do not intersect, the single the computer and superimposed on the output. The fiducials 

solution will be the correct value for T. Once the correct are used for registration or calibration of the system, 

value of T is determined, it is back-substituted into Eqn. 9 Preferably, the fiducials are positioned in the corners of the 

to determine the corresponding value for U. com P uler ° ul P ut Md < he s ^P e of < he Mucjals is known a 

Hie above example demonstrates that once CI', C2', C3'. 5 P"on to the system. Step 52 may be . periodically repeated 

and C4' are known, and the (X,Y) coordinates of external depending upon particular application. example^ step 

cursor 22 are determined, a straight-forward computation 52 may be initiated by the user to calibrate the system o 

. Jt , f /Tin u- u t iu~ « ^rri; automatically repeated at predetermined time intervals, or 

yields values for (T.U) which represent the mouse coordi- £ ^ ^ ^ ^ 

nates" for internal cursor 26 of the computer output. Because J y block 52 may be rep eated whenever the external 
the T-U coordinate system has been normalized, any coor- 10 ^ ^ nQ{ detected within the image 
dinates with T or U outside of the normalized range (0 to 1) M image of lhe compter oulput is captured as repre- 
can be ignored for tracking purposes because they do not fall sented by block 54 preferably, a camera which includes a 
within image 42 of computer output. To determine the scaled CCD arrav ^ \ n conjunction with an appropriate frame 
values for the coordinates of internal cursor 26, T is multi- capture card to capture the image. Preferably, the image 
plied by the horizontal resolution and U is multiplied by the 15 includes a substantial portion of the computer output, 
vertical resolution of the captured image 40. Once the However, depending upon the particular implementation, 
calibration or registration process has determined CI', C2', the image may include only the central portion or some other 
C3', and C4\ at least one property of external cursor 22 is region of the screen used to display the computer output, 
monitored or tracked by repeatedly capturing- anoSanalyzing Alternatively, the image may encompass the entire screen 
frames'as illustrated and described with referencelo FIG? 3. 20 used to display the computer output. 
In one embodiment of the present invention, position of The image is processed to detect position of the fiducials 
external cursor 22 is determined only while external cursor as represented by block 56. As indicated above, the opera- 
is within projected image 42 while various other properties tions represented by blocks 52 and 56 may be selectively 
of external cursor 22, such as shape, color, size, etc.* are repeated under various circumstances. Preferably, one of the 
monitored asiong^as r exte~rna11:ursor 22 is within captured 25 fiducials is utilized as the origin for a normalized coordinate 
image 40, i.e. even when external cursor 22 is outside of system to determine position of the external cursor relative 
projected image 42. to the computer output as described above. 

Referring now to FIG. 3, a flowchart illustrating operation After completing the calibration or registration process, 

of one embodiment of a system and method for remotely images arc repeatedly captured and processed as represented 

controlling a computer according to the present invention is 30 by blocks 58-72. Acaptured image, represented by block 58, 

shown. As will be appreciated by one of ordinary skill in the is processed to detect at least one property of an external 

art, the flowchart illustrated in FIG. 3 may represent any of cursor as represented by block 60. Preferably, the external 

a number of known processing strategies such as event- cursor is an optical cursor generated by a hand-held pointer 

driven, interrupt-driven, multi-tasking, multi-threading, and and includes at least one user selectable (changeable) prop- 

the like. Similarly, the present invention is independent of 35 erty. The selectable property or properties of the cursor are 

the particular programming language, operating system, or used to remotely control the computer. Cursor properties 

computer platform which may be used to implement the may include intensity, color, shape, or size, as represented by 

invention. As such, various steps or functions illustrated may blocks 62, 64, 66, and 68, respectively. In addition, cursor 

be performed in the sequence illustrated, in parallel or in properties may include a particular pattern of movement as 

some cases omitted altogether. Likewise, the order of pro- 40 represented generally by reference 70. Positiomofothe^xter- 

cessing illustrated is not necessarily required to achieve the nal cursor, represented by block 72 is^preferably^also 

objects, features, and advantages of the invention, but is detected^relative^to^the M posit jojuoj the .fiducials as^deje r- 

provided for ease of illustration and description. mined^by^block- 56t>In addition, any one or more of the 

Preferably, the control logic of FIG. 3 is implemented in properties may be used in combination to generate appro- 
software which is executed by a microprocessor-based 45 priate commands for the computer. For example, the posi- 
computer, such as a laptop or desktop computer, represented tion of the external cursor, represented by block 72, may be 
generally by computer 10 of FIG. 1. Of course, various used in combination with the color or shape of the cursor 
portions or functions of the control logic may be imple- which is represented by blocks 64 and 66 respectively, i.e., 
mented in software, hardware, or a combination of software the color and/or shape of the external cursor generate 
and hardware. The flowchart of FIGS. 3 illustrates one 50 different commands based on the position of the cursor, 
"loop" and its operations are preferably repeated at periodic The property or properties of lhe external cursor which 
time intervals or as required by some internal or external are detected by block 60 are converted to corresponding 
event, as known by those of skill in the art. Preferably, commands to control the computer as represented by block 
control, logic represented in FIG. 3 is embodied in data 74. This may be accomplished by any of a number of known 
stored on a computer readable storage medium, such as a 55 strategies. For example, a data structure may be used to 
floppy disk, hard disk, CD-ROM, tape, or other magnetic, associate various properties or combinations of properties 
optical or combination device. The computer readable stor- with corresponding commands in a particular software 
age medium includes data representing instructions execut- application. Of course, the particular commands generated 
able by a computer to generate commands for remotely may vary from one application to another. Preferably, the 
controlling a computer according to the present invention. 60 commands generated by block 74 control movement of the 

Output from a computer is displayed as represented by internal cursor generated by the computer such that move- 

block 50 of FIG. 3. Preferably, output from the computer is ment of the external cursor generated by the pointer causes 

displayed on an associated screen which may be a computer movement of the internal cursor generated by the computer 

monitor, external television or monitor, or an external "pas- to synchronize movement of the cursors. In addition, various 

sive" screen as described above. A plurality of fiducial or 65 context-sensitive or position-sensitive commands may be 

reticles are superimposed on the computer output as repre- generated by varying one or more properties for a particular 

sented by block 52. Preferably, the fiducials are generated by position of the external cursor. 
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The following provides a representative use of one 
embodiment of the present invention which includes a 
hand-held laser pointer with three aligned laser emitters 
arranged as an isosceles triangle. One emitter of the pointer 
is active at all times once the pointer is turned on. A second 
emitter is selectively activated by the user by pressing a first 
button which results in a command corresponding to a 
"left-mouse-button-click" command. All three emitters are 
selectively activated by the user by pressing a second button 
on the laser pointer which results in a command correspond- 
ing to a "right-mouse-button-click" command. In this 
embodiment, various properties-including the -intensity, 
color, and pattern (or shape) of ahe external c^ursprgene rated 
<by:the:laser- pointer are used to determine location of Ihe 
external cursor-inaddition to which button : (if Triy) is being 
depressed. When no buttons are pressed, a single high- 
intensity cursor in the shape of a dot, the color of the first 
emitter, is visible within the captured image frame. When 
the first button is pressed, the shape and color of the external 
cursor is changed in that a second dot appears located at 
some distance from the first dot. When the second button is 
pressed, the external cursor takes yet another shape and 
color consisting of two additional dots which appear as the 
remaining points of the isosceles triangle. The properties of 
the external cursor are detected and processed by the system 
to generate corresponding commands to remotely control the 
computer. 

While embodiments of the invention have been illustrated 
and described, it is not intended that these embodiments 
illustrate and describe all possible forms of the invention. 
Rather, the words used in the specification are words of 
description rather than limitation, and it is understood that 
various changes may be made without departing from the 
spirit and scope of the invention. 

What is claimed is: 

1. A method for remotely controlling a computer having 
an associated screen for displaying output from the com- 
puter and having an internal cursor generated by the 
computer, the method comprising: 

detecting at least one property of an external cursor and 

position of the external cursor relative to the output 

from the computer; 
generating a command to move the internal cursor to a 

position on the screen corresponding to the position of 

the external cursor; and 
generating a command for the computer based on the at 

least one detected property of the external cursor. 

2. The method of claim 1 wherein the step of detecting 
comprises: 

capturing an image of the screen and the external cursor 

with a camera; and 
processing the image to detect the at least one property of 

the external cursor, 

3. The method of claim 2 wherein the step of processing 
the image comprises: 

comparing the image to a previously captured image to 
detect differences between the image and the previ- 
ously captured image. 

4. The method of claim 2 wherein the step of processing 
the image comprises: 

filtering the image to detect the at least one property of the 
external cursor. 

5. The method of claim 4 wherein the step of filtering 
comprises thresholding the image to detect intensity of the 
external cursor relative to intensity of the computer output. 

6. The method of claim 4 wherein the step of filtering 
comprises filtering the image to detect color of the external 
cursor. 
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7. The method of claim 4 wherein the step of filtering 
comprises filtering the image to detect shape of the external 
cursor, 

8. The method of claim 1 further comprising transmitting 
the external cursor to the screen using a source of directed 
optical energy. 

9. The method of claim 1 wherein the associated screen is 
a substantially planar surface remotely located external to 
the computer and any associated monitor, the method further 
comprising projecting an image of the output from the 
computer onto the associated screen, 

10. The method of claim 1 wherein the associated screen 
is a computer monitor. 

11. The method of claim 1 wherein the step of detecting 
at least one property of the external cursor comprises 
detecting a pattern of movement of the external cursor. 

12. The method of claim 1 further comprising: 
projecting a plurality of fiducials onto the associated 

screen; and 

detecting position of the fiducials relative to output from 
the computer, wherein the step of detecting at least one 
property includes detecting position of the external 
cursor relative to at least one of the fiducials. 

13. The method of claim 12 wherein the step of generating 
a command for the computer comprises generating a com- 
mand based on the position of the external cursor only if the 
external cursor is within a region delineated by the plurality 
of fiducials. 

14. The method of claim 12 wherein the step of generating 
a command for the computer comprises generating a com- 
mand based on the position of the external cursor while the 
external cursor is within a region delineated by the plurality 
of fiducials but outside output from the computer, and 
generating a command for the computer based on the at least 
one property while the position of the external cursor is 
within the associated screen. 

15. The method of claim 12 wherein the step of detecting 
comprises detecting a pattern of movement of the external 
cursor. 

16. The method of claim 1 further comprising: 
displaying a plurality of fiducials on the associated screen 

wherein positions of the fiducials are determined based 
on position of the external cursor. 

17. A method for generating computer commands based 
on position and at least one property of an external cursor, 
the method comprising: 

displaying output from a computer; 

displaying the external cursor on the output; 

capturing an image of the output; 

processing the image to determine position and at least 
one property of the external cursor; and 

converting the position and the at least one property to 
corresponding computer commands so an internal cur- 
sor tracks position of the external cursor. 

18. The method of claim 17 wherein the step of displaying 
output from a computer comprises projecting an image of 
the output on a remotely located screen. 

19. A method for remotely controlling a computer, the 
method comprising: 

displaying output from the computer on a remotely 

located screen; 
projecting an optical cursor generated by a hand-held 

pointer on the remotely located screen; 
capturing an image of at least a portion of the remotely 
located screen; 
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processing the image to detect position of the optical 
cursor and at least one user selectable property of the 
optical cursor; and 

generating commands to control position of a cursor 
generated by the computer based on position of the 
optical cursor and to control functioning of the com- 
puter based on the at least one property of the optical 
cursor. 

20. The method of claim 19 further comprising: 
superimposing a plurality of fiducials on the remotely 

located screen, wherein the step of processing the 
image includes determining position of the plurality of 
fiducials within the image and determining position of 
the optical cursor relative to at least one of the fiducials, 

21. The method of claim 20 further comprising determin- 
ing position of the optical cursor relative to position of the 
output from the computer. 

22. The method of claim 20 wherein the step of super- 
imposing comprises moving the fiducials to expand a 
bounded region until the optical cursor is detected within the 
region bounded by the fiducials. 

23. The method of claim 20 wherein the step of super- 
imposing comprises moving the fiducials to reduce a 
bounded region surrounding output from the computer to 
reduce processing of the image. 

24. A computer presentation system for generating com- 
mands to remotely control a computer based on a plurality 
of user selectable properties of an optical cursor generated 
by a hand-held pointer and projected on a screen displaying 
output from the computer, the system comprising: 

a camera for capturing an image of the output from the 
computer; and 

a processor in communication with the camera for pro- 
cessing the image to detect position of the optical 
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cursor and at least one property of the optical cursor 
and for converting the position and at least one property 
to corresponding commands to control the computer 
and move an internal cursor to a position corresponding 
5 to the optical cursor while the optical cursor remains 
within the output displayed on the screen. 

25. A computer readable storage medium having stored 
data representing instructions executable by a computer to 
generate commands to control a cursor generated by the 

10 computer based on a plurality of user controllable properties 
of an external cursor, the computer readable storage medium 
comprising: 

instructions for detecting at least one of the user selectable 
is properties of the external cursor; and 

instructions for generating a command for the computer 

based on the at least one detected property of the 

external cursor. 

26. A computer readable storage medium having stored 
20 data representing instructions executable by a computer to 

generate commands to control the computer based on an 
external cursor projected onto an image of output generated 
by the computer, the computer readable storage medium 
comprising: 

25 instructions for processing an image of the output to 
detect at least one property of the external cursor 
including position of the external cursor relative to the 
output; and 

3 0 instructions for converting the position and the at least 
one property to a command to control the computer to 
move an internal cursor to a position corresponding to 
the external cursor. 

***** 
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